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ABSTRACT 

Parrondo games are coin nipping games with the surprising property that alternating plays 
of two losing games can produce a winning game. We show that this phenomenon can be 
modelled by probabilistic lattice gas automata. Furthermore, motivated by the recent 
introduction of quantum coin flipping games, we show that quantum lattice gas automata 
provide an interesting definition for quantum Parrondo games. 
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0. Introduction 

The simplest quantum lattice gas automata (QLGA) provide discrete models for the 1 + 1 
dimensional Dirac equation [1,2] and the multiparticle Schrodinger equation [3]. More com- 
plicated QLGA can be constructed to model potentials [4], inhomogeneities and boundary 
conditions [5]. In this talk we motivate the introduction of a QLGA model from a com- 
pletely new perspective — Parrondo games. 

A Parrondo game is a sequence of plays of two simpler games, each of which involves 
flipping biased coins. In §1 we review the somewhat surprising result that even if each of 
the simpler games is a losing game, an alternating sequence of them can be a winning game 
[6,7]. Meyer has recently initiated the study of quantum game theory with an example 
of a coin flipping game, PQ PENNY FLIP [8]. This raises the natural question: Is there a 
quantum version of Parrondo games? Although the quantum Parrondo game we construct 
is not a two player game (as PQ PENNY FLIP is) it introduces a formalism for coherently 
iterated games which we expect to be useful in contexts involving one, two, or more players. 

Parrondo invented the coin flipping game, however, to illustrate a physical phenome- 
non — Brownian ratchets [6,7]; in §2 we explain this connection in terms of a probabilistic 
discrete model — a random walk. This stochastic microscopic model captures the macro- 
scopic irreversible behavior of ratcheting, but raises the concern that a microscopic quan- 
tum model which is exactly unitary may not be able to do so [9]. The more immediate 
difficulty is the absence of any unitary version of a random walk. To get a 'quantizable' 
model we must first generalize to a correlated random walk [10], or equivalently, a proba- 
bilistic LGA; we explain this in §3. 

From here it is only a small step — actually an analytic continuation [11] — to a single 
particle QLGA. We review the unitary evolution rules in §4, emphasizing the inclusion of 
potentials which are necessary to model ratcheting. §5 contains the results of simulations 
which appear to illustrate quantum ratcheting, and which lead us to answer our motivating 
question by interpreting the single particle QLGA with appropriate potentials as a quantum 
Parrondo game. We conclude in §6 with a summary and some more physical observations. 



1. Parrondo games 

Consider games which involve flipping a coin: winning 1 when it lands head up and losing 1 
when it lands tail up. Suppose there are three biased coins A, B , and Bi, with probabilities 
of landing head up of p a , po, and pi, respectively. Define game A to consist of repeatedly 
flipping coin A. For p a < \, A is a losing game in the sense that if the initial stake is 
x = 0, after t plays the expected value of the payoff is (x) = t(2p a — 1) < 0. Even though 
one may win sometimes, in the long run one must expect to lose. 

After each flip the payoff x changes by ±1. Define game B to consist of repeatedly 
flipping coins B and B\: B when x = (mod 3) and Bi otherwise. This defines a 
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Markov process on x (mod 3) with transition matrix 
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One specific solution to equation (3) is (po,Pi) = (j^, |), but for a Parrondo game, £? 
should be a losing game, which means choosing p and p\ such that LHS(3) < RHS(3). 
Figure 1 plots (x) as a function of t for A and i? games defined by p a = | — e, po 
and pi = I — e, with e = 0.005. Each is 
clearly a losing game. 

Now suppose we combine these games. 
More precisely, suppose they are played 
in the order AABB, repeatedly. Figure 1 
plots the expected result of this game as 
well. Parrondo's 'paradoxical' observation 
is that this combination of two losing 
games is a winning game! To understand 
this phenomenon, rather than attempting 
to generalize the Markov process analy- 
sis of equations (l)-(3), let us go back to 
the physical system which motivated Par- 
rondo. 




Figure 1. The expected payoffs for games B, A 
and AABB as a function of number of plays t. 
Although A and B are losing games, the combi- 
nation AABB is a winning game. 



2. Brownian ratchets 

The payoff x for game A with p a = i executes an unbiased random walk on the integers, 
which is a discrete model for the diffusion equation in 1 + 1 dimensions [12]: 

Pt = Dp xx . (4) 

That is, the distribution p(x,t) = Prob(payoff = x at time = t) approximates p(x,t) in 
(4) with D = (Ax) 2 /2At. For p a 7^ | the random walk is biased and is a discrete model 
for diffusion with linear advection [12]: 

Pt + cp x = Dp xx , (5) 
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Figure 2. The payoff distribution for game A af- 
ter 100 plays. Va(x) is also graphed, in different 
vertical units. The initial distribution concen- 
trated at x = has spread and shifted downhill; 
the peak is now at —1. 



Figure 3. The payoff distribution for game B af- 
ter 100 plays. Vb(x) is also graphed, in different 
vertical units. The initial distribution concen- 
trated at x = has spread and concentrated in 
the valleys of Vg, but also shifted downhill. 



where c = (2p a — l)Ax/A£. Equation (5) describes Brownian motion of a particle in a 
linear potential Va(x) oc —(2p a — l)x; the particle diffuses and tends downhill, as shown 
in Figure 2* for the case p a = \ — e simulated in §1. 



Similarly, game B corresponds to Brownian motion of a particle in a piecewise linear 
potential. For a fair game, i.e., for po and p± satisfying equation (3), the potential (as well 
as its gradient) is periodic: 



V(x) oc 



(2p Q - l)x 
(2pi - l)x 



if \x — 3n| < b, n G Z; 
otherwise. 



(6) 



Here we assume < po < \ < pi < min{l, (3 — 4po)/2} and hence 



< b 



3(2pi - 1) 
4(pi - Po) 



< 1 



makes the piecewise linear potential continuous. For the losing game B simulated in §1, 
subtracting e from the fair game probabilities and | for p and p\ corresponds to adding 
the A game potential to the fair B game potential of (6): Vb(x) = V(x) + Va(x). In this 
potential, as shown in Figure 3*, the particle diffuses, concentrates in valleys, and tends 
downhill. 



* Figures 2-4 correspond to the same exact calculation of the distributions of payoffs for which the 
expectation values are plotted in Figure 1. To compensate for the familiar Z2 'spurious' conserved 
quantity in 1 + 1 dimensional LGA [13], the l t = 100' distributions plotted in Figures 2—4 are actually 
\p(x, 99) + 2p(x, 100) + p(x, 101)]/4. 
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Finally, Figure 4* shows the distribu- 
tion of payoffs for the combined AABB 
game. Alternating the games models a 
'flashing' potential [14], which allows dif- 
fusion uphill during A to be concentrated 
into uphill valleys by B, leading to an av- 
erage movement uphill. This phenomenon 
illustrates the use of a ratchet as a thermal 
engine, first explained by Smoluchowski 
[15] and subsequently discussed by Feyn- 
man [16], by Parrondo and Espahol [17], 
and by Abbott, Davis and Parrondo [18]. 
Such Brownian ratchets have been created 
experimentally in electromechanical [19] 
and optical [20] systems. 



Prob 




Figure 4. The payoff distribution for the alter- 
nating game AABB after 100 plays. Although 
the initial distribution has spread and concen- 
trated, it has shifted uphill. 



Recognizing Parrondo games as Brownian ratchets raises concerns about constructing 
quantum mechanical versions of them [9]: the thermal ratchet engine works only for sys- 
tems which are out-of-equilibrium (they require heat baths at two different temperatures) 
and dissipative (the pawl must bounce inelastically off the ratchet). It is hard to imagine 
exactly unitary systems modelling either of these properties. In fact, recent theoretical 
analysis [21] and experimental observation [22] of quantum ratcheting have depended on 
some degree of dissipation/decoherence. Our goal, in contrast, is an exactly unitary model. 



3. Correlated random walks 

The first obstacle we must overcome is the non-existence of a quantum random walk. 
More precisely, there is no nontrivial unitary band diagonal matrix which would describe 
the transition amplitudes from each lattice site to some neighboring set of lattice sites [23] . 
The intuition for this result is that the evolution of nontrivial classical random walks is 
not invertible and unitarity is simply the quantum manifestation of invert ibility. 



To construct an invertible model we 
must add an extra bit of information to 
each lattice site in Z, the direction from 
which the particle reached that site. Fig- 
ure 5 illustrates such a model: the arrows 
pointing to lattice sites record the direc- 
tion from which the site was reached and 
the (probabilistic) evolution rule shown is 
that the particle has probability p of con- 
tinuing in the same direction and proba- 
bility 1— p of changing direction. This is a 
correlated random walk [10]: the probabilities 




Figure 5. Evolution rules for a correlated ran- 
dom walk. The reflected rules may or may not 
have the same probabilities; if they do not, the 
random walk is biased. 



for successive steps are not independent for 
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p 7^ |. For p — |, however, they are uncorrelated, so this model specializes to the standard 
random walk. To obtain an uncorrelated but biased random walk, the probabilities should 
be independent of the previous outcome, but not symmetric under reflection (i.e., parity). 

We can also think of this as a probabilistic LGA. The extra bit of information is the 
particle momentum and, as we have described it, one timestep of the evolution consists of 
two parts: scattering, defined by a stochastic matrix 

followed by advection. Although this is the opposite order to the usual way we think of 
LGA evolution, the two only differ by a time translation of 'half a timestep'. In fact, long 
before the earliest LGA were constructed to model fluid flow [24], Goldstein [25] and Kac 
[26] showed that this probabilistic LGA is a discrete model for a physical system — a 1 + 1 
dimensional wave equation with dissipation: 

1 , 2a i 

—z<Pu + —z<pt - <Pxx = u, 

V V 

where v = Ax/ At and a = (1 — p)/ At. The a — > limit of this 'telegrapher equation' is 
the wave equation, and the a, v — > oo limit with v 2 /2a = D is the diffusion equation (4). 

This correlated random walk/probabilistic LGA corresponds to a generalization of 
coin flipping games in which the probability of winning each play depends on the outcome 
of the previous play, and thus provides a framework in which to generalize Parrondo 
games. Parrondo, Harmer and Abbott have also introduced a generalization in which the 
probability of winning each play depends on the history of the game to that point — the past 
two outcomes in their case — although their motivation is to eliminate the x dependence of 
the game [27]. Our motivation is different: we want to preserve this dependence, since it 
corresponds to a spatially varying potential, but use the generalization instead to construct 
unitary versions of these games. 



4. Quantum lattice gas automata 

Now that we have a stochastic scattering matrix (7), it is straightforward to replace it 
with a unitary matrix 

jj _ <— / cos 9 i sin 9 
— > yisin^ cos# 

although we must reinterpret the state space of the LGA to do so. Let \x, a) denote the 
presence of a particle at lattice site x G Z with momentum a G {±1}- States of the 
probabilistic LGA are convex combinations 

f = ^2fx, a \x,a) 1 with < f Xia G R and J^/ X ,a = 1, (9) 
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so that f Xja is the probability that the particle is in the state \x, a). Evolution consists of 
scattering according to (7): 

\x, a) I— > p\x, a) + (1 — p)\x, —a), 

followed by advection 

i— > p\x + a, a) + (1 — p) \x — a, —a), 
extended by linearity to general states / (9). 

For a QLGA, the general one particle state is a vector in Hilbert space [2,4,5,28]: 

ip = ^ ipx,a\x,a), with ip Xja E C and |^x, a | 2 = 1, (10) 

so that ip x ,a is the amplitude of the state |x, a) and IV^al 2 is the probability that, if 
measured in this basis, the particle is observed to be in state \x,a). Quantum evolution 
consists of scattering according to (8): 

\x, a) I— > cos 6\x, a) + i sin 9\x, —a), 

followed by advection 

I— > cos 6\x + a, a) + i sin 6*|x — a, —a), 

extended by linearity to general states if) (10). This evolution is unitary because the scat- 
tering stage is, and because the advection is deterministic. Furthermore, we can include 
a potential with multiplication by an x-dependent phase e ~ lV ^ [4,28]; the evolution re- 
mains unitary. The problem thus reduces to picking parameters 9, V(x,t) to achieve 
ratcheting — which we can also interpret as a quantum Parrondo phenomenon. 

5. Quantum Parrondo games 

Since we are going to exhibit our results as outputs of simulations, we should first remark 
that although we may think of our single particle QLGA as a particle moving from lattice 
site to lattice site with specified amplitudes, on a classical computer we must simulate it 
using a lattice Boltzmann method. That is, we must keep track of the whole vector ift and 
evolve that at each timestep. In fact, this is how we performed the exact computations 
for the probabilistic LGA for Figures 1-4. In the probabilistic case we have the option of 
simulating it as a lattice gas and averaging over multiple runs — the results of Harmer and 
Abbott were obtained this way, using 50,000 runs [7] — but for the quantum case we do not 
have this option. 

We set 9 = j in (8) so that the magnitudes of the amplitudes are all the same — this 
is the analogue of an unbiased, uncorrelated random walk. The initial state is an equal 
superposition of |0, —1) and |0, +1) so that there is the same initial capital — zero — as in 
the classical simulations, and no bias for the initial momentum/state at t = —1. Figure 6 
shows the expectation value (x) as a function of t for 

2ir 7r 1 

Va(x) = 5000 X ^ ^(*) = -[!--(£ mod 3)] + y A (z). 
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Figure 6. The expected payoffs for quantum 
games B, A and BAA A A as a function of number 
of plays t. Although A and B are losing games, 
the combination BAAAA, played repeatedly, is 
a winning game over this range of numbers of 
plays. These results illustrate the same 'para- 
doxical' phenomenon as those in Figure 1 do for 
the classical Parrondo game. 



Figure 7. The payoff distribution for quantum 
game A after 100 plays. Vj^{x) is also graphed, 
in different vertical units. The initial distribu- 
tion concentrated at x = contained equal left 
and right moving amplitudes which have shifted 
to peaks at about i68 and spread. Interference 
has created a series of peaks at smaller absolute 
payoffs; the average has shifted slightly downhill. 



As in the classical case, Va is a linear potential, as shown in Figure 7, and Vb is a piece- 
wise linear 3-periodic potential superimposed on Va, as shown in Figure 8. Figure 6 shows 
that the behavior is similar to the classical cases: Potentials Va and Vb individually force 
(x) downhill, but the flashing pattern — BAAAA, repeated — drives (x) uphill. (We chose 
the parameters in these potentials to produce expectation value curves similar to those 
shown in the classical cases; they differ by only about a factor of 2 after 100 plays.) As 
shown in Figure 7, the evolution in Va is biased downhill, but looks very little like the 
diffusive evolution of Figure 2. Similarly, as shown in Figure 8, the evolution in Vb is 
biased downhill, and concentrates periodically, but otherwise looks quite different than the 



Prob 




Figure 8. The payoff distribution for quantum 
game B after 100 plays. Vb (x) is also graphed, 
in different vertical units. The initial distribution 
has shifted left/right, and spread. Vg has caused 
a more complicated interference pattern than Va , 
but the average has also shifted downhill. 
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-100 -50 50 100 

Figure 9. The payoff distribution for the alter- 
nating game BAAAA after 100 plays. The dis- 
tribution still shows the results of interference, 
but the large positive peak slightly outweighs the 
large negative peak to give an average which has 
moved uphill. 
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diffusive evolution of Figure 3. Finally, as shown in Figure 9, flashing the potentials in 
the order BAAAA, repeatedly, biases the evolution uphill, but still in a way unlike the 
classical case of Figure 4. Interpreting this QLGA as a quantum Parrondo game, Figure 9 
shows that this is a game for gamblers with high tolerance for risk — the large probability 
of a big loss is just barely outweighed by the slightly larger probability of a big win. 

6. Conclusions 

By interpreting classical Parrondo games as probabilistic LGA, we have motivated the 
introduction of QLGA to answer the question: Are there quantum Parrondo games? The 
simulations shown in §5 appear to answer this question in the affirmative, as well as to 
demonstrate discrete quantum ratcheting, despite the absence of dissipation. 

The quadratic growths of (x) shown 
in Figure 6, however, should be worrisome 
since the single particle QLGA discretizes 
the Dirac equation [2,4,28], which is rel- 
ativistic. If (x) were to continue to grow 
quadratically, it would eventually exit the 
lightcone — not relativistic behavior. Fig- 
ure 10 shows the results of simulation out 
to t = 5000. We see that the expectation 
values do not continue to grow quadrati- 
cally; rather their evolution is oscillatory 
and the small t quadratic growth is that 
of A(cos(bt) - 1). In fact, the QLGA with 
potential Va discretizes the 'Dirac oscilla- 
tor' [29] which can be solved exactly, and 
in which wave packets are known to evolve 
approximately periodically [30]. For random stopping times — i.e., measurement times — 
however, both the A and B games are losing games and the BAAAA quantum game is 
a winning game. In this sense the QLGA is a quantum Parrondo game. In the broader 
context of game theory, it also illustrates a coherently repeated quantum game — and the 
possibility of interference between sequences of plays. This kind of construction should 
generalize to, for example, a quantum version [31] of the MINORITY game [32]. 

More physically, Aharonov, Ambainis, Kempe and Vazirani also use random stopping 
times to obtain a related result: quantum (unitary) simulation of sampling from equilib- 
rium distributions of diffusion processes on graphs with constant vertex degree [33]. The 
quadratic speedup they find is due to the linear in time (rather than yt as in the classical 
random walk) spread of the wave function illustrated in Figure 7 [34]. More generally, 
Childs, Farhi and Gutmann demonstrate the same quadratic speedup for a continuous 
time quantum process on certain graphs, without the constant vertex degree restriction 
[35]. Our results, and these, provide specific answers to the general question of whether 
quantum computers (see, e.g., [36]) can calculate properties of classical systems more effi- 
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Figure 10. The expected payoffs for quantum 
games A, B and BAAAA as a function of num- 
ber of plays t. Although the curves are periodic, 
for random times (or on average), A and B have 
negative expected payoffs while BAAAA has a 
positive expected payoff. 
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ciently than can classical computers [37]. 
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